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I.   INTRODUCTION 

This  paper  is  devoted  to  deterministic  inventory  models  for  three 
primary  reasons.   The  first  is  that  such  models  provide  considerable  insight 
about  inventory  models  which  may  not  be  deterministic.   The  second  is  that 
many  stochastic  models  are  approximated  by  deterministic  ones  (for  example, 
by  using  expected  demand  rates  in  place  of  deterministic  ones).   The  third  is 
the  limited  variety  of  deterministic  models  which  have  been  studied  in  the 
literature.   The  first  two  reasons  are  of  particular  importance  to  people 
who  are  applying  inventory  theory  to  real-world  inventory  systems. 

Past  work  [3]  on  deterministic  inventory  models,  with  few  exceptions, 
has  assumed  the  nature  of  the  ordering  policy  to  withti  one  or  two  unknown 
parameters.   For  example,  a  periodic  review  model  might  specify  that  a 
quantity  Q   can  only  be  ordered  at  the  end  of  a  known  period  of  time  T. 
The  unusual  problem  would  be  to  determine  the  value  of  the  parameter   Q  which 
minimizes  the  total  purchase  or  production  plus  holding  costs.   If,  however, 
the  nature  of  the  optimal  policy  need  not  be  specified  prior  to  the  analysis 
then  we  would  expect  that  the  complete  nature  of  the  optimal  policy  will  result, 

Unfortunately,  if  the  nature  of  the  ordering  policy  is  not  specified 
then  considerable  complexity  of  analysis  can  result  if  one  attempts  to  use  the 
differential  calculus  (see,  for  example,  the  work  of  Arrow  and  Karlin  [2]). 
This  complexity  can  be  reduced  however  if  the  Maximum  Principle  of  Pontryagin 
et  al  [4]  is  used  in  determining  the  optimal  ordering  policy.   Such  an  approach 
will  be  taken  in  this  paper. 

The  paper  begins  with  an  analysis  of  the  no-stockout  periodic  review 
problem  posed  by  Arrow  and  Karlin  [2]  to  illustrate  the  approach  and  the 


-1- 


simplicity  of  analysis  that  it  provides.   Then  an  analysis  of  a  periodic  review 
problem  with  stockouts  allowed  is  made  to  show  how  the  allowing  of  stockouts 
complicates  the  optimal  control  problem. 

II.   NO-STOCKOUTS  PROBLEM 

Model  Formulation — This  is  a  generalization  of  the  problem  formulated  by 
Arrow  and  Karlin  [2].   We  are  interested  in  scheduling  the  production  of  an 
item  so  as  to  minimize  its  production  plus  holding  costs  over  a  specified 
period  of  time  T.   We  will  assume  a  zero  lead  time.   Let 

I(t)  =  the  inventory  level  at  time   t; 

r(t)  =  demand  rate  at  time   t; 

u(t)  =  the  production  rate  at  time   t. 
Both   r(t)   and   u(t)   are  to  be  non-negative. 

All  demands  are  assumed  to  be  met  and,  as  a  consequence, 

rt 

I(t)  =  1(0)  + 

J 

where   1(0)   represents  the  on-hand  inventory  at  the  beginning  of  the  time  period. 
We  can  rewrite  (1)  as 


[u(t)  -  r(x)]dT  :>  0  (1) 

0 


u(r)dT  £ 
0         > 


r(T)di  -  1(0)  (2) 

0 


and  consider  it  to  represent  a  constraint  on  u(t). 

The  production  and  holding  costs  per  unit  time  will  be  represented  by 
c(u(t))   and  h(I(t))   respectively.   We  will  assume  that  they  are  monotone- 
increasing  and  continuously  dif ferentiable  in  their  respective  arguments.   No 
other  costs  are  assumed  to  exist.   The  total  production  plus  holding  costs 
for  the  period  are  given  by  (3) . 

a 


J(u) 


[c(u(t))  +  h(I(t))]dt   .  (3) 

^0 
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Our  objective  is  to  find  a  policy  u(t)  £  0  which  satisfies  (2) 
and  minimizes  (3). 

The  Maximum  Principle  for  the  Problem — For  convenience,  we  will  refer  to  (3) 
in  the  following  form  in  our  analysis: 


J(u)  =    f  (u,I)dt   . 
j0 

In  applying  the  Maximum  Principle  a  function  called  the  Hamiltonian 
is  created  as  follows: 

H(u,I,p0,P;L,t)  =  p0(t)f0(u,I)  +  Pl(t)  j±  (4) 

The  derivative  —  is  obtained  by  differentiating  (1).   The  Hamiltonian,  upon 

introducing  the  expressions  for   f   and  —  ,   is  given  by  (5)  where   t   has 
been  suppressed. 

H(u,I,p0,p1)  =  p0[c(u)+h(I)]  +  P]L[u-r]  (5) 

For  fixed   I,  p  ,   and  p   let  M(I,p  ,p  )  =  max  H(u,I,p  ,p-)   over  the  domain 

of  u(t)   values  satisfying  u(t)  ^  0  and   I(t)  ^  0 

The  necessary  conditions  for  optimality  of  our  problem  from  the 
Maximum  Principle  are  given  by  the  following  theorem  [4] . 

Theorem:   An  admissible  order  policy  u*(t)   and  the  resulting  inventory  level 
I*(t)   are  optimal  if  there  exist  continuous  functions  PaCO   and  P-.  (t) 

which  satisfy 

dl   3H 


dt   3Pl    '  (6) 

dpo 

dT  "  °    •  (7> 
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dp,     ju 

dt~   "  dl   ;  (8) 

P0(T)  =  -  1   ;  (9) 

Pl(T)  =  0   ;  (10) 

such  that 

H(u*,I*,p0,P;L)  =  M(I*,p0,Pl) 

for  all   t   in  [0,T] . 

The  condition  given  by  (10)  is  a  consequence  of  the  transversality 

condition  for  a  free  right-hand  end  condition  for   I(t)   ;   that  is,  we  are  not 

going  to  force   I(T)   to  take  on  any  specified  value.   This  is  a  point  of  major 

difference  between  this  analysis  and  that  of  Arrow  and  Karlin[2]  and  Adiri  and 

Ben-Israel  [1].   In  both  of  these  studies  the  assumption  was  made  that   I*(T)  =  0. 

If,  however,   I(T)  =  0  is  really  optimal  then  the  results  of  the  analysis  should 

show  it.   We  shall  see  below  that  they  do. 

The  Optimal  Policy — Examining  the  conditions  from  the  theorem  we  get  back  from 
(6)  our  constraint  that  -r—  =  u(t)  -  r(t)   and  consequently  that 


I(t)  =  1(0)  + 


-t 

[u(x)-r(x)]dT 

0 


with   1(0)   as  the  given  initial  condition.   From  (7)  and  (9)  we  get  Pn(t)  =  ~1 
for  all   t   in  [0,T] .   From  (8)  we  get 

dpl       d  h(I) 


dt     ^0   dl 


and,  because  P^Ct)  =  ~1> 


dp 


1   d  h(l) 


dt      dt 
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Solving  for  p  (t) , 


Px(t) 


d  h(I) 
dl 


dT  +  P;L(0)   . 


(11) 


Because  of  (10)   p  (T)  =0   is  needed  and  it  follows  that 


Px(0)  -  - 


d  h(I) 
dl 


di 


and, therefore ,  (11)  reduces  to 


Px(t)  =  " 


d  h(I) 
dl 


di   . 


(12) 


dH 
We  will  find  —  helpful  in  selecting   u*(t) 
du 


From  (5)  we  obtain 


dH      d  c(u) 

du"  =  P0  "^     +  Pl 


(13) 


Substitution  of   p.(t)  =  -1   and   p  (t)   as  given  by  (12)  into  (13)  then  results 
in 


dH  _  _  d  c(u) 
du       du 


d  h(I) 
dl 


di   . 


(14) 


Because  we  assumed  -r-  >    0  and  — r- —  >  0   it  is  immediately  evident  from  (14) 

du  dl 

dH 
that  —   <  0   for   t   in   [0,T]   and   therefore  that  the  maximum  value  of   H 
du 

occurs  for  the  smallest  value  of   u(t)   which  satisfies   u(t)  ^  0  and   I(t)  ^  0 

Therefore,  we  deduce  that 


u*(t)  = 


0    for  0  £  t  <  t   ; 
r(t)  for  t  £  t  £  T  , 


(15) 


where   t..   is  obtained  (1)  when   I(t  )  =  0;   that  is,  from 


r(T)dT  =  1(0) 
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In  other  words,  the  optimal  order  policy  is  to  first  use  up  the  on-hand  inventory, 
then  order  to  just  meet  current  demand.   We  see  that  no  inventory  is  held  after 
the  initial  inventory   1(0)   is  consumed.   It  is  therefore  immediately  evident 
that   I(T)  =  0  under  this  policy. 

Comments — The  optimal  policy  is  intuitively  appealing.   When  there  are  costs  assoc- 
iated with  both  production  and  holding  inventory  we  would  like  to  avoid  incurring 
either  if  we  can.   The  constraints  require,  however,  that  we  meet  demand  when  it 
occurs.   Waiting  to  produce  until  we  have  used  up  the  existing  inventory   1(0) 
keeps  inventory  holding  costs  to  a  minimum  because  we  reduce  the  inventory  as 
fast  as  possible  while  incurring  no  production  costs.   Producing  only  to  meet 
demand  after  the  inventory   1(0)   is  used  up  insures  that   I(t)   is  zero  and 
therefore  that  no  holding  costs  are  incurred.   The  production  costs  incurred  are 
only  those  necessary  to  meet  the  demand.   The  only  restrictions  we  placed  on 
c(u)   and   h(I)   were  that 

dc(u) 


du 

dh(I) 
dl 


>  0   for   u  ^  0   , 

>  0  for   I  :>  0   . 


We  could  also  allow    .^   ^  0  and  get  the  same  result.   For  example,  if  there 

dl 

is  no  holding  cost  for  items  in  storage  we  would  get  (14)  in  the  reduced  form 

dH  =  _  dc_ 
du      du 

and  the  optimal  policy  given  by  (15)  still  holds.   Our  result  is  much  more 

general  than  that  of  Arrow  and  Karlin  [2]  who  required  c (u)   to  be  convex  and 

continuously  twice  dif f erentiable  in  addition  to  being  monotone  increasing.   Further 

they  only  considered  the  case  of  h(I)  -  hi.   Our  result  is  also  more  general  than 

that  of  Adiri  and  Ben-Israel  [1]  even  though  they  used  a  general   h(I). 
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III.  STOCKOUTS-ALLOWED  PROBLEM 


Model  Formulation  —  The  problem  when  stockouts  are  allowed  in  general  form 

is  to  find   u(t)  ^  0  which  minimizes  (3);  ie, 

T 


[c(u(t))  +  h(I(t))]  dt   , 
0 

where  now  h(I)   represents  holding  and  shortage  costs. 

dH 
The  Hamiltonian  and  —  in  this  case  are  the  same  as  (5)  and  (1A) 

du 

respectively.   They  are  repeated  here  for  convenience. 

H(u,I,p0,  P;L)  =  pQ  [c(u)  +  h(I)]  +  p±    [u-r]   . 

dh  _   dc(u)    fT  dh(I) 

du  ""     du    J     dl        ' 

The  theorem  stated  in  the  previous  section  still  provides  the  necessary  condit- 
ions for  optimal  u(t).   Although  the  assumption  that  — >  0  for  u  ^  0 

A  Vi 

remains  reasonable,  the  assumption  -r=r    ^  0   is  no  longer  reasonable  over  all 

possible   I(t)   values  because  the  "stockouts-allowed"  case  can  result  in 

I(t)  <  0.   We  expect  instead  that  —  ^  0   for   I(t)  <  0  because  a  reduct- 

dl 

ion  in  the  number  of  shortages  should  result  in  a  decrease  in  stockout  costs. 
It  is  therefore  possible  to  get 


»dr<.  , 


dl 
t 

and  if  this  integral  is  large  enough  it  could  cause 

*  *  0 

du 
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for  some  values  of  t  in  [0,T].  If  this  should  happen  then  optimal  u 
would  be  infinite  unless  we  impose  an  upper  bound  on  its  range.  We  will 
therefore  assume   u(t)  £  b  <  °°  . 

It  is  important  to  observe  that  we  will  always  have 


dH 
du 


dc(u) 
du 


>  0   . 

t=T 

We  can  therefore  say  that  regardless  of  the  form  of   h(I)   the  optimal 

* 
ordering  policy  will  always  have  u  (T)  =  0.   This  information  will  be  ex- 
tremely useful  in  the  analysis  of  the  problem  allowing  stockouts. 

To  progress  beyond  this  observation,  we  must  select  a  form  for  h(I). 

Suppose  we  assume  a  linear  form  as  follows: 

/ 


h(I(t))  =/ 


-h  I(t)    for    I(t)  £  0 


h2I(t)    for    I(t)  ^  0   . 


where  h  >   0  and  h  >   0  represent  the  shortage  and  holding  costs  per 

unit  of  inventory  per  unit  time.   When  we  attempt  to  obtain  the  derivative 
—   of  this  form  we  realize  that  it  does  not  exist  at   I(t)  =  0.   If,  instead, 
we  assume  that   h(I(t))   smoothly  transitions  from  -h  I(t)   at   I(t)  =  -e 
to  +h_I(t)   at   I(t)  =  +  e   for   e  >   0  but  very  small  then  the  derivative 


will  exist  at  any  point  in  the   £ -neighborhood  of    I(t)  =0.   If  we  assume 
further  that  the  minimum  point  of  the  h(I)   curve  occurs  at   1=0  we  can 
approximate  —  by  the  following  form: 

'  -h1  for   I(t)  <  0 

||  =  <  0   for   I  ft)  =  0 

h   for   I(t)  >  0   . 
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dc 
For  convenience  we  will  also  assume  —  =  k  and   r(t)  =  r  where  k 

du 

and  r  are  positive  constants. 


Preliminary  Observations  about  the  Optimal  Policies — Under  the  model  assumpt- 
ions we  see  that  if   I(t)  >   0  over   [0,T]   then 


f  .-k- 

du 


T 

h2dr  =  -k  -h2[T-t]  (16) 


and  we  realize  that  —  <  0   for  all   t   in   [0,T] .   The  optimal  order  policy 

* 
is  u  (t)  =  0.   Now  if   1(0)  ^  rT,   we  will  get   I(t)  -  l(0)-rt  >   0   for 

u(t)  =  0   except  possibly  at   T  where   I(T)  =  0  when  1(0)  =  rT. 

Suppose  next  that   1(0)  <  0  and  we  order  nothing,  then   I(t)  =  1(0)  -rt  <  0 

for  all   t   in   [0,T].   In  this  case, 


f£  =  -k  +  h   [T-t]   ,  (17) 

du         1 

dH  dH 

and  it  is  possible  to  get  —  ^  0.   If  we  set  -r~  =  0  and  solve  for   t   in 

du  du 

(17)  we  get 

t  =  T  -  |   .  (18) 

hl 

dH 
In  the  range   t  <  t    we  have  —  >  0;   in  the  range   t  <  t  £  T  we  have 

du 

Because  T,k,  and  h   are  parameters  of  the  problem  it  is  possible  to 

dH 
have   t  <  0  so  that  -r—    <   0  over  all   t   in   [0,T] .   This  will  occur  when 

du 

T  <  7-  .   The  optimal  policy  when  this  happens  is  to  order  nothing;   ie, 
hl 

u*(t)  =  0. 

When  T  >  —   then  -t—   >   0   if  we  order  nothing.   However,   3—  >   0 
h         du  °  du 

* 

implies  that   u  (t)  =  b.   If  b  >  r   then  it  is  possible  to  get   I(t)  >   0 
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towards  the  end  of  the  time  period  and  (17)  would  no  longer  apply.   Some 
form  such  as  (19)  is  suggested  for   t   in   [0,t.]   where  t   is  the  value  of 
t  when  I(t)  =  0. 


^  =  -  k  +  h1[t1  -  t]  -  h2[T-t;L]   .  (19) 

In  spite  of  the  additional  complex  forms  for  —  which  may  arise,  they  will 
all  have  an  appearance  similar  to  (19) . 


The  Optimal  Policies — The  optimal  policies  for  the  stockouts-allowed  problem 
will  be  stated  before  the  arguments  leading  to  these  policies  are  presented. 
Before  stating  the  optimal  policies  it  is  convenient  to  define  several 
quantities. 

Let 


h  [r-b]t 
Zl"  V*p   ■  (20) 


I2  -  [r-b]t     ,  (21) 


I3  -  rt   ,  (22) 


:    [h.+h_]I(0)  -  h.[r-b]t 

t  =  — - — (23) 

where   t,   given  by  (18),  is  repeated  here  for  convenience, 

hl 
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The  optimal  order  policies  are: 


1.   If   t  >  0  and   (a)   0  <  b  <  r,   1(0)  £  I  ,   or   (b)  b  ^  r, 
1(0)  £  I  ,   then 


b   for   0  <;  t  £  t   , 
u  (t)  = 

0   for   t  <  t  £  T 


2.   If   t  >  0,   0  <  b  <  r,   and   I   <  1(0)  <  I  ,   then 


* 
u  (t) 


" 


0  for  0  £  t  <  t   , 

b   for   t  £  t  £   t   , 

0   for   t  <  t  £  T 


3. 


If   t  >  0,   b  ^  r,   and  0  £  1(0)  £  I  ,   then 


'  0  for  0  *  t  <  ii& 

r 


u  (t)  -  /  r   for 


K0) 


£  t  ^  t 


0  for  t  <  t  £  T   . 


4.   If   t  >   0,   b  £  r,   and   I   <  1(0)  <;  0,   then 


'  b   for   0  S  t  *  ^^ 


-K0) 


*/  N     /       r      -1(0 

u  (O  -  <  r   for  -^ 


[b-r] 


[b-r] 


<  t  £  t 


0  for   t  <  t  £  T   . 


5.   Otherwise  u  (t)  =  0  for  all   t   in   [0,T] 
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* 
Proof  of  the  Optimal  Policies — We  have  already  shown  that   u  (t)  =  0  if 

k 
1(0)  ^  rT  or  if   I(t)  <  0  and   t  <  0   (that  is,   T  <  —  )   in  our  pre- 

hl 

dH 
liminary  comments.   These  cases  corresponded  to  -r~      <  0   over  all   t   in 

du 

[0,T].   We  can  add  I(t)  <  0  and   t  =  0   to  this  list  immediately  because 

t  =  0  corresponds  to  —  =  0  at   t  =  0  and  thus  —   <  0    for  all   t   in 

du  du 

(0,T]. 


Turning  next  to  the  case  of   I(t)  £  0  and   t  '-■    0  we  realize  that, 

dH 

du 


dH 
because  (17)  applies,  -j-     >      0   for   t   in   [0,t).   In  this  time  period 


u  (t)  =  b  is  the  policy  which  will  maximize   H(u).   The  period  (t,T]   has 

dH  ^       *  *  * 

—   <  0   in  (17)  and   u  (t)  =  0.   The  switch  from  u  (t)  =  b   to   u  (t)  =  0 

du 

takes  place  at   t. 

The  conditions  necessary  for  maintaining   I(t)  £  0  can  be  obtained 

from  consideration  of  the  following  equation  for   I(t)   which  results 

from  the  optimal  policy  just  stated. 


/ 


Kt)  =/ 


1(0)  +  [b-r]t   for   0  £  t  £  t 


1(0)  +  bt  -  rt   for  t  <  t  ^  T 


If  b  <  r  then  I(t)  decreases  as  t  increases  over  [0,T] .  Therefore, 
if  1(0)  £  0  then  I(t)  £  0  over  [0,T] .  If  b  =  r  then  I(t)  =  1(0)  as 
long  as   u(t)  =  b  and  decreases  as  soon  as  u(t)  =  0. 

If   b  >   r   it  is  possible  to  have   I(t)  >  0.   Now  if   b  >  r   the  max- 
imum value  of   I(t)   occurs  at   t .    if    I(t)   is  to  be  nonpositive  then 
we  must  have 
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I(t)  =  1(0)  +  [b-r]t  £  0 
I(t)  £  0  will  occur  if 


1(0)  £  [r-b]t=  I2 


where   I„  <  0  because   b  >   r 


In  summary,  we  have  just  shown  that 


b   for   0  £  t  £  t   , 
u  (t)  = 

0   for   t  <  t  j£  T   , 

for  all  the  conditions  except   0  <   1(0)  £  I,   for   0  <  b  <  r   of  the  first 
optimal  policy. 

For   1(0)  >  0   it  is  also  possible  to  —  >  0   for  some  portion  of  [0,T\ 
We  will  concentrate  on  the  range   0  <  1(0)  <  rT   because  we  have  already 
shown  that   u  (t)  =  0   for   1(0)  ^  rT .   If   u(t)  =  0  and   1(0)   is  in  this 
range  then   I(t)  <  0   for   t  <  t  £  T  where 


The  corresponding  expression  for  —  is 


-k  -h2[t1-t]  +  h1[T-t1]   for   0  £  t  £  t1   , 

|»  =  I  (25) 

-k  +h  [T-t]  for  tx  as  t  £S  T   . 


J  u 

-t—  has  a  slope  of   (+h_)   in  the  region  0  ^  t  i  t,   and  a  slope  of   (-h  ) 
du  z  I  -1- 

dH 
in  the  region   C,  £  t  £  T.   A  representative  family  of  -=—  curves  for  (25) 
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are.  shown  in  figure  1  and  covers   1(0)  values  for   [0,rT].   The  curves 

designated  by   1  and  5   correspond  to   1(0)  -  0  and   1(0)  =  rT,   respect- 

dH 
ively.   The  optimality  condition  —  =  -k  for   t  =  T   is  imposed  on  each 

curve  of  the  figure. 

dH 
Any  curve  between  1  and  2   suggests  one  switching;   that  is,   — 

is  positive  for   t  <  t   and  negative  for   t  >  t.   Any  curve,  such  as   3   , 

dH 
between  2  and  4   suggests  two  switchings  because  —  is  negative,  then 

positive,  and  then  negative  again.   Any  curve  between  4  and   5   suggests 

no  switching  should  take  place. 

It  is  immediately  evident  that  conditions  resulting  in  -r—  curves 

du 

* 

between  4   and   5  can  be  added  to  the  u  (t)  =  0  list.   Curve  4   corres- 
ponds to   t1  =  t  which,  when  stated  in  terms  of   1(0),   results  in 

1(0)  =  rt=  I3 

Therefore,  if   1(0)  ;>   I3      then  u  (t)  =  0  for  all   t   in   [0,T]. 

Because  u(t)  =0  is  not  optimal  for  the  curves  between  1   and  4 
we  will  first  investigate  the  behavior  of   I(t)   when  we  follow  the  switch- 
ing patterns  suggested  by  the  curves.   We  will  then  re-evaluate  the  express- 
ions for  —  .   This  process  may  require  several  iterations  before  a  pair 

of  "matching"   I(t)   and  -j—     curves   can  be   obtained  signalling  that 

optimal   u(t)   has  been  found. 

One  switching  should  be  considered  for  conditions  creating  the  curves 

dH 
between  1   and  2   ;  the  switching  should  occur  at  —  =  0.   From  figure  1 

we  know  that  -r—   =  0  only  in  the  segment  dominated  by  h   and  that  (17) 

applies.   Therefore  switching  should  occur  at   t. 
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•-t 


Jtt 

Figure  1.   -7—  curves  for  equation  (25) 
&        du 
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If  we  let 


then,  from  (1) , 


u(t)  -  ( 


b   for   0  £  t  £  t   , 

0   for   t  <  t  £  T   , 


1(0)  +  [b-rjt   for  0  <l   t  £  t   , 


(t)  =  / 


(26) 


1(0)  +  bt  -  rt  for   t  <  t  £  T   . 
A  family  of   I(t)   curves  for  (26)  is  shown  in  figure  2.   Curve   1   is 
representative  of  a  case  when  b  >  r.   Curve   2   results  from  b  =  r.   Curves 
3,4,   and  5   correspond  to  b  <  r.   Curve   5  has  b  =  0  and  is 

the  limiting  curve  for  the  b  <  r   cases. 

dH 
Figure  3  shows  the  curves  of  -j~     corresponding  to   I(t)   curves  of 

figure  2.   The  same  curve  numbers  have  been  used  in  both  figures  to  show 

dH 
the  correspondence.   Curves  between   1   and   3  have  —  <  0  over   [0,T] 

du 

and  suggest  that  no  switching  is  optimal.   Curves  between   3  and   5   suggest 

that  at  least  one  switching  is  optimal. 

dH 
For  any  curves  between  4   and   5  we  see  that  -r~     has  the  same 

du 


behavior  as  in  figure  1  for  curves  between  1  and   2 

/ 

b   for   0  £  t  £  t  , 


Therefore, 


u  (t)  =  { 


0   for   t  <  t  £  T  , 
dH 


for  the  conditions  leading  to  these  -r-     curves 

du 


dH 


The  first  condition  is  that   0  <  b  <  r.   The  second  is  that  ^  ^  0 

du 

at  t  =  0.   Translating  this  into  a  relationship  involving   1(0)   we  have 


"°» s  1^  [hiT"k^  h 
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I(t)  * 


1(0) 


Figure  2.   Curves  of   I(t)   for  equation  (26) 
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dH 
du 


dH 

du 

figure  2 


Figure  3.   —  curves  associated  with  the   I(t)  curves  of 

^        du 


-18- 


This  analysis  has  been  based  on  the  assumption  that   1(0)  >  0,   therefore 

the  proof  of  the  first  optimal  policy  is  complete. 

We  consider  next  the  curves  between   3  and  4   .   Figure  2   indicates 

that   0  <b  <  r  and  figure  3  shows  that  two  switchings  may  be  optimal; 

the  first  at  some  time   t   prior  to   t   and  the  second  at   t.   The  following 
policy  is  therefore  suggested. 


u(t)  = 


0   for   0  £  :f  .<  t   , 
b   for   £  £  t   £  t   , 

0  for   t  <  t  £  T   . 


(27) 


The  corresponding  expression  for  I(t)   would  then  be 

/ 


(t)  =  / 


1(0)  -  rt  for   0  £  t  <  t 

1(0)  +  b[t-tl  -  rt  for  t  £  t  £  t 
1(0)  +  b[t-t]  -  rt   for   t  <  t  £  T 


(28) 


Figure  4  illustrates  the  family  of  curves  associated  with  (28)  and 

dH 
figure  5  presents  the  corresponding  -j—  curves.   From  these  two  figures  we 

see  that  curves   2  and   3  will  have   u  (t)   given  by  (27).   To  find  the 

5  dH 

value  of   t  we  set  -r—   =0   in  equation  (19)   where  now   I(t)  =  0  at 

du 


;    1(0)  -  rt 

t.  s  t  i 

1         b  -  r 


We  will  get  the  expression  given  by  (23)  and   t  >  0  if 


h-[r-b]t 


Similarly,   t  <  t   if 


1(0)  <  rt  e  I 


3   * 


When   1(0)  -  I1    we  get      t  =  0  and  the  optimal  policy  given  by 
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r(t) 


Figure  A.   Curves  of   I(t)   for  equation  (28) 
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dH 


Figure  5.   Curves  of      associated  with  the   I(t)  curves 
of  figure  4. 
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(27)  reduces  to  that  derived  above  for  the  case  of   1(0)  £  I   and   I(t) 
corresponds  to  curve  4  of  figure  4.   If   t  =  t   then  (27)  reduces  to 
u  (t)  =  0  and  I(t)  corresponds  to  curve   1  of  figure  4.   We  have  already 
shown  that  u  (t)  =0   if   1(0)  ^  I   regardless  of  the  relationship  of 
b   to   r.   In  summary,  when   t  >   0,   b  <  r,   and   I   <  1(0)  £  I    then 
u  (t)   is  given  by  (27)  and  the  second  optimal  policy  is  confirmed. 

To  complete  the  analysis  of  cases  for   1(0)  ^  0  we  next  consider  the 
case  of   b  ^  r.   When  b  =  r   the  bound   I    is  zero  while   I„   does  not 
change  so   0  ^  1(0)  ^  I„.   Equation  (23)  reduces  to 

I   -  10?1 

r 

We  realize  that   t   occurs  simultaneously  with   t   as  given  by  (24) 

and  hence   I(t)  ■  0  between  t  and   t.   Equation  (31)  shows  that  -r— 

du 

dH 
is  constant  over  this  interval  because  -j—  =  0  for   I(t)  =  0  was  assumed 

du 


'    -k  -  h  [t-t]  +  h  [T-t]   for   0  £  t  £  t 


dH 
d 


-  =  <   -k  +  h  [T-t]  for   t  £  t  £  t        (31) 

,  -k  +  h  [T-t]  for   t  £  t  £  T   . 

dH 
From  the  definition  of   t  we  also  realize  that  this  constant  value  of  -r- 

du 

* 
must  be  zero.   Therefore   u  (t)   can  take  on  any  value  between  0  and  b. 

However,  I(t)  =  0   for   t   in   [t,t]   only  if  u  (t)  -  b. 

This  argument  can  be  easily  extended  to  the  case  of   b  >  r.   The  optimal 

policy  should  take  the  following  form,  however; 

0  for   0  £  t  <  t 

I 

u  (t)  =  (  r   for   t  £  t  £  t  (32) 

0  for   t  <  t  £  T   . 
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The 


dH 


dH 

du 


corresponding  expression  for  -j—  is  again  given  by   (31)  and  since 
=  0  over   t  £  t  £  t  we  can  assign  any  value  of   u  as  optimal  between 


0  and  b.   The  only  value  of   u  which  will  maintain   I(t)  =  0  over   [t,t] 

is  now  u(t)  =  r.   Figure  6  illustrates  the  resulting  curves  of   I(t)   and 

-7—   •   The  third  optimal  policy  has  been  proved. 
du 

These  arguments  can  also  be  used  for  the  case  of   b  >   r   and   I9  <  1(0)  £  0, 


dH 
du 


We  recall  that   u(t)  =  b   for   [0,t]   and  zero  outerwise  would  result  in 
I(t)  >  0.   Figure  7  contains  possible   I(t)   curves.   The  corresponding 
curves  are  shown  in  figure  8. 

The  curves   3   in  the  two  figures  correspond  to  the  case  of   1(0)  =  I„ 

and  the  first  optimal  policy  applies  (equation  (32)  would  have   t  =  0) . 

dH 
The  curves   1  and   2   from  figure  7  do  not  allow  -r-   =  -k  for   t  =  T  and 

du 

hence  u(t)   given  by  (32)  is  not  optimal.   However,  if  we  assume  the  following 
form  for  u(t)  we  can  satisfy  this  condition. 


u(t)  =   < 


for  0  £  t  £  t   , 
for   £  £  t  £  t   , 

for   t  £  t  £  T   , 


(33) 


where  now 


dH 


t  = 


KO) 
[b-r] 


The  resulting  equation  for  —  is 

du 


-k  +  h  [t-t]  +  h  [T=t]     for  0  £  t  £  t 


dH 
du 


-k  +  h  [T-t] 
-k  +  h  [T-t] 


We  realize,  as  we  did  for  (31),  that 


dH 
du 


for  t  £  t  £  t 
for  t  £  t  £  T   . 

=  0   for   t  £  t  £  t   and 
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^t 


dH 
du 


-k-- 


dH  * 

Figure  6.   I(t)  and  *=—  curves  for  u  (t)  given  by  equation 

(32). 
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I(t) 


Figure  7.   Possible   I(t)   curves  for  b  >  r,  1(0)  <  0, 
u(t)  =  b  over  [0,t] . 
-25- 


dH 

du 


-k    ■ 


dH 
Figure  8.   Curves  of  -r-     associated  with  the   I(t) 

du 

curves  of  figure  7. 
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1(0) 


dH 


Figure  9.   Curves  of   I(t)   and  -z —  for  u  (t)   given 


by  (33). 
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that  we  should  select  u(t)  =  r   to  maintain  I(t)  =  0  over  this  interval. 

Therefore  (33)  gives  the  optimal  policy  when  I-  <  1(0)  ^  0.   The  curves  of 

dH 
I(t)   and  —  are  shown  in  figure  9.   The  proof  of  the  fourth  optimal  policy 

is  complete. 


Comments — When  stockouts  are  allowed  we  see  that  the  analysis  becomes  immedi- 
ately more  complex  because  the   I(t)  ^  0  constraint  has  been  removed  and 
therefore  the  region  of  feasible  u(t)   has  expanded  to  always  include 
u(t)  =  0.   The  assumption  of  an  upper  bound  on  u  and  specific  forms  for 
the  elements  of  the  cost  function  appear  necessary  before  an  analysis  can 
proceed. 

The  linear  problem  presented  in  the  preceding  section  was  chosen  for 
the  illustration  of  the  stockouts-allowed  analysis  primarily  because  the 
cost  functions  are  typical  of  many  deterministic  models  appearing  in  the 
literature.   Future  analyses  will  investigate  the  influence  of  several  diff- 
erent nonlinear  cost  forms.   It  should  be  evident  from  the  preceding  analysis 
that  while  the  use  of  the  Maximum  Principle  allows  a  general  order  policy  to 
be  postulated,  it  requires   that  careful  consideration  be  given  to  the  form 
of  the  objective  function.   In  contrast  to  the  no-stockouts  model,  the 
nature  of  the  form  selected  will  strongly  influence  the  nature  of  the  optimal 
order  policy. 

The  iterative  procedure  of  postulating  u(t),   evaluating   I(t)   and 

-j—   ,   and  re-postulating  u(t)   until  finally  a  "matched  set"  of  expressions 

dH 
for   I(t)   and  —  is  obtained  seems  to  hold  considerable  promise  for 

problems  having  nonlinear  cost  functions.  The  virtue  in  obtaining  the  "matched 

set"  is  that  then  both  the  necessary  and  sufficient  conditions  for  optimality 

have  been  obtained. 
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